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ABSTRACT 
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When  an  orthogonal  projection  is  to  be  computed 
using  data  acquired  by  distributed  sensors,  it  is  often 
necessary  to  process  each  sensor's  data  locally  and  then 
transmit  the  results  to  a  central  facility  for  final 
processing.  The  most  efficient  way  to  do  this  is  to 
compute  oblique  projections  locally.  This  choice  makes 
the  final  processing  a  matter  of  summing  the  oblique 
projections .  -- Irr  this  paper  derive^new  formulas ,  and 
iterative  algorithms  and  associated  error  bounds,  for 
oblique  projections  in  arbitrary  Hilbert  spaces. 
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INTRODUCTION 


The  solutions  to  many  signal  processing  problems  can  be 
characterized  in  terms  of  orthogonal  projection  in  an  appropriate 
Hilbert  space.  Linear  least-squares  filtering,  smoothing,  and 
prediction  are  notable  examples.  Most  existing  algorithms  for 
orthogonal  projections  were  developed  with  the  assumption  that  all 
the  data  would  be  available  for  processing  at  a  central  location. 
In  the  case  of  data  acquisition  by  distributed  sensors  this  assump¬ 
tion  is  not  always  realistic  because  constraints  on  the  communica¬ 
tion  links  may  prohibit  the  transmission  of  the  sensors'  data  to  a 
central  facility  for  processing.  In  this  case  the  data  subsets 
must  be  processed  locally  (at  the  sensor  sites)  to  produce  appro¬ 
priate  summaries  which  will  then  be  transmitted  to  a  central  loca¬ 
tion  and  combined  to  yield  the  desired  orthogonal  projection. 

The  primary  issue,  then,  is  to  decide  what  partial  results 
should  be  computed  locally  so  that  the  overall  problem  is  solved  as 
efficiently  as  possible.  An  obvious  choice  is  to  let  each  partial 
result  be  an  orthogonal  projection  onto  the  subspace  determined  by 
the  relevant  data  subset.  In  this  way  each  processor  will  be  sol¬ 
ving  a  smaller-scale  version  of  the  overall  problem.  However, 
there  is  a  serious  difficulty  with  this  choise. 

To  illustrate,  let  V  be  a  Hilbert  space  and  let  H  be 
the  closed  subspace  of  V  spanned  by  the  data.  Suppose  the  data 
are  partitioned  into  two  subsets.  Then  these  subsets  individually 


span  two  closed  subspaces  H  and  H  such  that  H  =  H  *H  . 

A  £  A  £ 

Suppose  ff^rVfo={0}  and  let  the  orthogonal  projection  operators 
onto  H,  Hj  and  H0  be  denoted  by  P,  P 1  and  P  ,  respectively. 
For  a  vector  zey,  if  we  decide  to  find  Pz  by  first  computing 
P;z  and  P.7,  locally,  then  we  must  combine  these  partial  results 
according  to  the  following  formula  due  to  Aronszajn  [A2]: 

Pz  =  (i-P^fl-P/^PjZ  *  (I-P^fl-P/jf^^. 

It  is  clear  that  the  operations  needed  to  combine  P^z  and 
P0z  are  more  complex  than  those  required  to  compute  either  of 
these  projections,  thus  producing  a  computational  bottleneck  at  the 
central  facility.  We  note  that  all  two-filter  smoothing  formulas 
are  special  cases  of  the  above  formula.  Adamyan  and  Arov  [AA] , 
Salehi  [S2],  and  Pavon  [P]  have  applied  this  formula  directly  to 
solve  certain  stochastic  interpolation  problems.  As  an  example  of 
how  it  specializes  in  the  case  of  decentralized  Kalman  filtering, 
see  Speyer  [S4].  We  note  that  there  is  no  generalization  of 
Aronszajn 's  formula  to  the  case  of  more  than  two  subspaces. 

In  fact,  the  bottleneck  inherent  in  the  above  approach  can 
be  avoided  by  computing  oblique,  rather  than  orthogonal,  projec¬ 
tions  at  the  local  sites.  This  choice  makes  the  combination  of  the 
partial  results  as  simple  as  possible,  namely  one  of  straight  addi¬ 
tion.  As  will  be  discussed  in  more  generality  later,  the  direct 
sum  decomposition  H  =  uniquely  determines  two  oblique 

projection  operators  L  and  L  such  that 

I  ^ 
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Pz  s  L  z  +  L2z. 


In  comparing  this  formula  with  Aronszajn's  given  previously,  it 
should  be  noted  that  the  right-hand  sides  do  not  correspond  term  by 


term  since  L^z  and  L^z  lie  in  H ^  and  respectively. 


It  is  the  purpose  of  this  paper  to  derive  new  formulas,  and 
iterative  algorithms  and  associated  error  bounds,  for  oblique 
projections  in  arbitrary  Hilbert  spaces.  Although  same  results 
along  these  lines  exist  for  decompositions  involving  only  two 
subspaces  (two  data  subsets)  [Al],  [A2],  [G] ,  [TYM] ,  [Y] ,  there  are 
no  such  results  for  decompositions  involving  more  than  two  sub¬ 
spaces.  We  should  note  that  in  certain  more  specific  settings,  it 
is  possible  to  determine  oblique  projections  using  the  concept  of 
superposition  [RW] ,  [WC] .  Along  these  lines,  Chang  [C]  was  able  to 
rearrange  the  computations  in  Speyer's  decentralized  Kalman 
filtering  algorithm  so  that  oblique  projections  were  computed  and 
then  summed.  He  was,  however,  unaware  of  the  geometric  interpreta¬ 
tions  of  his  algebraic  manipulations.  Finally,  the  concept  of 
oblique  projection  has  been  applied  in  various  other  contexts  [HB] , 
[KD],  [SI],  [S3],  [TYM],  [Y] . 
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OBLIQUE  PROJECTION  FORMULAS 

Let  H  and  H ^  ( i  =  l  ,2 , .  . .  ,k)  be  closed  subspaces  of  a 

Hilbert  space  v  such  that  H  has  the  direct  sum  decomposition 

H  =  H^HjB  ■■■  *Hk. 

Let  the  orthogonal  projection  operators  onto  H  and  H .  be  P  and 
P  ,  respectively.  Let  us  also  introduce  the  notation  to  mean 

the  direct  sum  of  the  k-l  subspaces  excluding  H.,  that  is, 

H,  =  H,®  • * •  ®H  ,©•••©#,. 

0>  1  l-l  l+l  k 

Since  for  any  zev ,  Pz  is  an  element  of  H,  it  can  be 

decomposed  uniquely  as 

Pz  *  z ,+  z>  •  •  •  +  z, 

12  k 

where  z^e//.  [i-l ,2 ,  .  .  .  ,k)  .  The  map  that  takes  z  to  z. 
determines  a  unique  linear  idempotent  operator  L.  called  the 
oblique  projection  operator  onto  H  along  where  W1  is 

the  orthogonal  complement  of  H.  Thus 

Pz  =  L,z  +  Lz  +  ••■  +  L.z. 

12  k 

The  range  and  null  space  of  L.  are  H  and  respect¬ 

ively.  Note  that 

L  L  =  O ,  i*j . 

1  J 


The  earliest  discussions  of  oblique  projection  operators 
appear  to  be  those  in  Murray[M]  and  Lorch[Ll].  Other  useful 


treatments  can  be  found  in  Afriat[Al],  Halmos[Hl],  Kato[K] , 
Lyantse[L2],  and  Takeuchi  et  al  [TVM] . 

For  i  =  /, 2 . k,  let  M  .=  and  let  iz.  be  the 

orthogonal  projection  operator  onto  M  .  It  is  clear  that 

p~p i  •  71 1  ij  be  defined  as 


for  l$J$i$k,  and 


ir  ,  =i 
nj 


whenever  i<j. 


In  addition,  let 


It 

n 

u 


ki2 ' 
k-lll  ’ 

i-llinkli+l ' 


i=l , 
i=k , 

2< i <*-i  . 


Theorem  1:  The  oblique  projection  operator  L  .  ( i  =  l  ,2 ... 

■  ■  .k)  is  given  by 

L  = 

2  PIT.  ,,,11,.  ,(I-n  JI  ,  iu$k. 

2  i-iii  kij+lK  j 

Proof:  Note  that  this  theorem  gives  a  different 

representation  of  the  oblique  projection  operator  L  for  each 
j-l  ,  2 , .  . .  ,k .  Vie  will  prove  only  the  representation  for  j-k .  The 


other  representations  follow  in  a  similar  manner. 

Using  IT  ^  P-P  for  i  =  l  ,2 , .  .  .  ,k ,  we  see  that 


Similarly,  the  first  tern  on  the  right  can 


since 

be  expanded  as 


k-i  a 


ir~r 


k-lJ  k-2ll  k-2ll  k-1  k-2ll 


Combining  these  two  relations,  we  have 


n , n ,  *  n ,  p i  i  _ , ,  -  p ,n . 

k  k l  k-2il  k-l  k-2il  k  k-1 11 


Expanding  u 


k-2U 


and  continuing  in  the  same  manner,  we  get 


nknki=  P  ~  Pinoil  ~  P2nill 


~  Pknk-lir 


We  can  rearrange  this  equation  as  follows: 


p—n  n .  —  p( i-n .n.)  -  p  n  +  p ji  +  •••  +  p .u , 

k  kl  1  k  klJ  1  Oil  2  1  il  k  k-1  il 


Since  by  Lemma  A5  exists,  the  result  of  the  theorem 

for  j=k  follows.  0 


There  is  another  class  of  representations  for  oblique 
projection  operators  that  uses  the  inverses  of  selfadjoint 
operators.  Let  us  introduce  the  following  additional  notation: 


*  n  n  •••il  . 

1TJ  1  1+1  j 


for  l^i^Jik  and  n ^ .  *  /  whenever  i>j.  Furthermore,  let 


n. 


n  i  t*  < 


n 


T  k ' 

nk-i  ’ 


n i+i  r k11!  r i-i 


i=i . 
i=k , 

,  2$Hk-i . 
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Theorem  2:  T.ie  oblique  projection  operator  L  .  ( i=l ,2 ... 
.  . , k )  is  given  by 


L .  =  P.tt.Jl 

i  ill 


n.n.n.J 

it  i  i  iJ 


Proof:  Since  77.  is  a  factor  of  neither  77.  nor  77.  ,  we 

i  it  1 1 

can  write,  as  in  the  proof  of  Theorem  1, 


77  .  77  .  27  .  .  =  P  ~ 
It  l  ll 


P.27  - 

1  1 1 


where  r  denotes  the  sum  of  the  remaining  terms,  none  of  which 
have  P.  as  a  left  factor.  Now 

P  -  27  .  27  .27  .  =  PfI-n  .  .27  .27  .  ,  )  =  P  77.  ,  y-  P, 

itiii  itiii  i  il  ' 

and 

p  =  p  .n .  Ji-n  tn  .n .  S1  +  r(i-u .  n  n .  )~J  . 

]  itiii  v  itiiiy 


The  necessary  inverse  exists  by  Lemma  A5 .  This  decomposition 
clearly  indicates  that 


L  .= 
i 


P  .77,  ,(1  -  27  ..27  .27  .  ,/ 
J  2  T  1  l 


□ 


Note  that  77^=27^,  where  27*  ^  is  the  adjoint  of  77^. 

Therefore  sel Joint .  One  can  also  obtain  the 

result  of  Theorem  2  directly  from  Theorem  1  (with  j=i )  using  the 

easily  established  fact  that  L  n  =  L  ,  m*n . 

in  n  m 
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SERIES  EXPANSIONS  AND  ITERATIVE  METHODS 


I.  The  Case  of  Two  Subspaces 

For  the  case  of  two  subspaces  the  oblique  projection 
operators  given  by  Theorem  1  (with  j=i)  are 

V  vV;  -  vV_i' 

V  P2ni(l  ~  n2ni)~1 • 

These  expressions  can  be  written  in  a  form  more  conducive  to 
iterative  implementation.  The  following  lemmas  are  basic  in  this 
direction. 

Lemma  1:  Under  the  stated  assumptions  on  and  H , 

r/,u  -  r/2u  *  ii®/2  ii  -  #*/2u  <  >■ 

Proof:  Since  H2r\Hj={o}  and  =  {<?},  we  have 

cos  r(Hr>,H1)  =  cos  )• 

and 

cos  r(n2,nJ)  =  cos  *c(i*2'N1). 

These  angles  are  defined  in  the  Appendix.  From  Lemma  Al  we  have 
the  equality 


cos  VW' 

In  addition,  it  is  well-known  (see,  for  example,  Youla  [Y] )  that 

II  Vi  H  =  HVJ  =  C°S 
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II ff/JI  =  ll”/”oll  =  cos  'F(n2,nl), 


Since  H»H0  is  closed,  we  have  {)  >  0  by  Lemma  A2.  Now 

the  result  follows.  □ 


Lemma 


v^V  u2  *  IPip21  pin2  for  n“ 


Proof:  For  n=l ,  we  have 


WjV  pI(p-p2np-p,)”2'  p,pffr 


Assume  that  the  lemma  is  true  for  n=m.  Then  for  n=m+l ,  we  have 


\,-J 

*;S: 

v»\ 


•'El*. 


V^V”  V  Pl(n2ni)  *2*1*2 

-  (Wmpin2nin2 

-  (PlP2^P2n2- 


Therefore  the  lemma  is  true  for  n=m+i ,  and  thus  it  is  true  for  all 


1 


For  two  subspaces  the  oblique  projection 


operators  are  given  by 


V  [I~P1P2J~  P1Q2 ' 


l2=  fI~P2PlJ _  P2°i' 


with  Q  =l-P  . 

i  i 


Proof:  We  start  with  the  oblique  projection  formula 
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JftMAMAMUtfUVW' 


Since  by  Lemma  1  |jff^2j|(J  ,  the  above  inverse  can  be  expanded  in  an 
absolutely  convergent  von  Neumann  series  [K]  to  give 


_  <x>  _  00 

l  =  )  Pttjnnj 1  =)  MffXj'ff 
1  1  “  "  ^i=o  1  *■  1 


Now  if  we  apply  Lemma  2  to  each  term  of  the  series,  we  get 


v  I  ,/wVs- 


-1=0 


From  Lemma  A5  and  Lemma  2,  (I-P  P  )  exists  and 

7  I. 


J  “  w' 

*~i=o 


Therefore 


Now  the  result  follows  from  the  fact  that  P  =  P,Q0.  The  formula 
«•  12  12 


for  can  be  derived  similarly,  o 


Note  that  we  started  with  the  formulas  given  by  Theorem  1 
for  j=i.  In  fact,  all  of  the  other  formulas  given  in  Theorem  1 
and  Theorem  2  will  lead  to  the  same  expressions  given  in  Theorem  3. 

The  formulas  just  derived  were  previously  obtained  by 
Aronszajn  [A2]  in  series  form,  and  by  Afriat  [Al]  in  operator  form 
using  other  methods.  The  above  derivation  clearly  points  out  the 
special  structure  that  exists  in  the  case  of  two  subspaces.  As  we 
will  see  later,  this  state  of  affairs  has  no  analog  in  the  case  of 


algorithm  suitable  for  decentralized  problems.  We  will  work  with 
L 1 ,  but  all  the  results  apply  to  L  as  well  with  the  obvious 
changes  of  subscripts. 

From  Theorem  3  we  have 


V- 


Let  L {  be  the  truncated  version 


Ltn)='\7  (p  p  Jjp  q  . 

1  Z1=0L  1  2J  r i  2 


It  is  clear  that  lim  L\  =  L,.  Therefore  the  sequence 

n-t oo  li 


(71)  .(71)  ,  „ 

x  =  Lj  z  ,  n=  1  ,2 ,  .  .  . 


converges  to  z^L^,  the  oblique  projection  of  z  onto  H 1  along 
H .  By  breaking  off  the  first  term  in  the  formula  for  Lltn  ,  we 


,  (n )  _  ^  _  n  r  m-i > 

L1  2  ■  Pia2Z  '  P1 P2L1  Z ' 


Thus  we  have  the  iteration 


(O) 

with  x  =0.  Clearly,  L^z  is  the  fixed  point  of  the  map 

F:  U  <-  P jP 2U  *  P jQ2Z'  • 

Since  \\P^P^\\<1,  F  is  strictly  contractive.  Thus,  the  approxi¬ 
mating  sequence 

tm  „  m-1) 
x  =  Fx 

will  converge  to  l^z  for  any  starting  point  in  V.  Furthermore, 
any  other  fixed  point  algorithm  can  be  used  to  generate  the  oblique 
projection. 


Figure  1 


Figure  1  provides  a  sketch  of  how  the  iteration  works.  The 


element  zev  is  first  projected  orthogonally  onto  H~  to  form 
Q0z ,  which  is  then  projected  orthogonally  onto  to  obtain 


IV  J 

X 

Then,  the 

operator 

p1p2  *s  applied 

.  (V  ) 

to  X 

and 

the 

result 

is  added 

(V  1 

to  -Y 

( 2 ) 

to  produce  x 

Next,  the 

operator 

PVP2 

is  applied 

rt 

O 

* 

to 

and  the  result  is 

added  to 

(V  ) 

X 

to 

( 3 ) 

produce  x  .  The  iterates  get  progressively  closer  to  the  point 

V 

It  is  important  to  note  that  our  iterative  algorithm  has 
the  property  that  each  xin)  is  an  element  of  H  .  This  is 
critical  for  decentralized  problems  in  which,  typically,  the 
processor  computing  z  has  access  only  to  the  data  set  spanning 
H j  .  The  iterative  oblique  projection  algorithm  of  Youla[Y] ,  which 
is  valid  only  in  the  complementary  subspaces  case  (V=H) ,  does  not 
share  this  property. 

As  with  any  iterative  procedure,  it  is  useful  to  have  a 
good  a  priori  error  bound  so  that  the  number  of  iterations  needed 
to  achieve  a  desired  accuracy  can  be  reliably  estimated.  To  this 
end  we  will  need  the  norm  of  the  oblique  projection  operator.  The 
result  of  the  next  lemma  is  due  to  Aronszajn[A2] .  It  was  redis¬ 
covered  by  Del  Pasqua[D] ,  Lyantse[L2],  and  by  Youla[Y] ,  who  gives 
an  accessible  proof  for  complementary  subspaces.  The  extension  to 
non-compl ementary  subspaces  is  straightforward. 


Lemma  3:  The  norms  of  the  oblique  projection  operators  are 


where  s  =  sin  *(ll2,H  ). 


Now,  the  error  operator  for  the  iterative  algorithm  is 


given  by 


l1JPlP2J‘Pia2  =  X‘jPW‘Pja2 

<PJP/j>n  l“jPlP2P1>>Pia2 


The  next  theorem  gives  the  sharpest  known  upper  bound  on  the  norm 
of  the  error  operator. 

Theorem  4=  ||£|/?,||  *  | ¥p f  2P ^  L j\\  < 

where  c  =  cos  r(H  H  )  and  s  =  sin 

*  1  2  1 

Proof:  Since  p1p2Pj  *s  selfad joint 

>fw/ll  -  llV/Jf- 

Therefore 

The  desired  result  follows  from  Lemma  3  and  the  well-known  fact 
that  WPf/j  \\=r2 .  a 

A  looser  bound,  namely  cn  J/s,  was  given  by  Aronszajn[A2] . 
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In  the  case  of  three  or  more  subspaces,  the  oblique 
projection  operators  can  also  be  expressed  in  terms  of  infinite 
series.  To  this  end  we  need  the  following  lemma  which  is  analogous 
to  Lemma  1. 


Lemma  4 :  If  the  sum  of  any  number  of  the  subspaces  H  , 
is  ciosed'  'then 

II™  J  *  <  * 

for  isj ,2, . . . ,k. 

Proof:  Here  we  will  prove  the  lemma  for  the  case  of  i-k. 

The  others  will  follow  similarly. 

Let 

n .  =  ns\n,  ,n  •  •  •  rw  . 

k-.j  k  k-i  j 

for  Jsj  ,2 , .  .  .  ,k .  From  our  earlier  work  on  error  bounds  for  the 
method  of  alternating  projections  [KW] ,  and  [HS] ,  we  have 


where  s  =  sin  r  (n  n  )  for  j-2,3 . k.  Using  Lemma  A1 

k:J  c  J-l 

we  get 

s,  ~  sin  V  (H.mH.  ,  H 

k:j  cl  k  k-l  j'  j-iJ 

Since  by  our  hypothesis  is  closed,  we  have 

■s,  >0  for  J=2 ,3 , . . .  ,k  by  Lemma  A2.  This  proves  the  lemma  for 


We  can  new  present  the  series  expansions  for  the  oblique 


projection  operators. 


Theorem  5 :  Under  the  hypothesis  of  Lemma  4,  the  oblique 
projection  operator  L  (i  =  l  ,2 . ,k)  can  be  written  as 


L  .= 
i 


l 


i  A  * 


Proof:  From  Theorem  1  (with  j=i)  we  get 


l  .=  p  n .  fi-n  n .  ) 

i  ii  i  ii 


-i 


Now  Lemma  4  allows  us  to  expand  the  inverse  operator  in  a  von 
Neumann  series,  as  follows: 


oo  00 

L.=  \  p  n .  Jn.ii.  =  S  p  (u .  n  )mn. 

1  4=o  :  iA  2  2i  4=o  2  2i  2  2A 


.  □ 


Since,  in  the  case  of  three  or  more  subspaces,  there  is  no 
result  analogous  to  Lemma  2,  we  cannot  derive  an  iterative  oblique 
projection  algorithm  like  the  one  presented  earlier  for  the  case  of 
two  subspaces.  Instead,  we  must  compute  each  term  in  a  truncated 
version  of  the  infinite  series.  Again,  each  term  in  the  series  for 
L.  is  an  element  of  H. ,  and  can  therefore  be  computed  using  only 
the  data  set  which  spans  H . . 

In  order  to  decide  on  how  many  terms  to  retain  in  the 
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series,  we  need  an  upper  bound  on  the  error  operator 


where 


rtm 
E  . 

i 


Ltn1  =  \  p.n.Jn.n .  l1 


*5  p  .n .  An  u .  Aa(u  n .  ,)n 

=  l  fn  n  )n . 

r  i 


As  before,  we  need  to  evaluate  the  norm  of  the  oblique  projection 
operator  in  order  to  derive  an  upper  bound  for  the  norm  of  the 
error  operator. 


Lemma  5:  The  norm  of  the  oblique  projection  operator  L ^ 
(isi  ,2 , . . . ,k)  is  given  by 

IIM  - 

where  s  .=  sin  r(H .  ,H r  . 

i  1  i  o>' 

Proof:  Since  we  can  write  H=H.QH(.y  for  i*l ,2 , . . .  ,k , 
Lemma  3,  which  dealt  with  two  subspaces,  applies  with  the  obvious 
identifications.  □ 


A  bound  on  the  norm  of  the  error  operator  will  be  given 
only  for  i=k  to  avoid  introducing  new  notation.  One  can  always 
rename  the  subspaces  so  that  the  following  theorem  applies. 
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where 


6:  ||s‘n)||  =  ^k(nkaklf[[ 


n . 

«k/sk‘ 


V  sln  r‘"f  «a>>- 


2  2  2 
sk:ksk:k-i"'sk:2‘ 


and  for  j=2 ,3 , . . .  ,k 

Sk:j*  *in  Hj.j)- 


Proof:  Since  <  llL*)l II need  to 

derive  an  upper  bound  for  11**^  J.  We  know  from  the  proof  of 
Lemma  4  that 


iiVi/  < '  - 

where 

Since 

■  -M  )m  .{0) 

we  have 

WW' •  "V  »j-,>  *  -“V  VW- 

Now  the  result  follows  by  an  application  of  Lemma  5.  □ 

An  even  sharper  upper  bound  can  be  derived  by  applying  the 
fundamental  inequalities  in  Kayalar  and  Weinert[KW]  to  \\(nknkl Jn||. 
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APPENDIX 


In  this  appendix  we  will  first  state  the  definitions  of 
minimum  and  complementary  angles,  and  then  give  some  basic  results 
concerning  angles  and  products  of  projections. 

Let  H 1  and  be  closed  subspaces  of  a  Hilbert  space  V. 

Definition  Al:  The  minimum  angle  between  the 

subspaces  H  and  H ^  is  the  angle  between  o  and  rc/2  whose 
cosine  is  given  by 

cos  ?{H2,H1)  =  sup{\(y,x)\:  y€H2,xeH;  ,||y||^l  ,  j|x||^}, 
where  <  • ,  ■  >  is  the  inner  product  in  V . 

If  we  remove  the  intersection  from  the  two  subspaces,  we 
get  a  slightly  different  definition.  Let  H  £  H  DH  . 

Definition  A2 :  The  complementary  angle  between 

H0  and  Hl  is 

Note  that  if  H .  rw  *  {n} ,  then  2)  ■ 
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Lemma  Al:  Let  H  and  {«r}  be  closed  subspaces  of  a 
Hilbert  space  V,  with 

H  =  HyHja  • • •  9Hk 

and 

« .  .=  ffVi hl  ,n-  •  •rvfinff . 

ij  *  i-i  J 

Then 

TP  (M .  .  J  =  TP  ,®  •••  ®tf  H  . 

el  2;J  j-lJ  cl  i  2-1  J  J-l7' 

for  2<j<z<*. 

Proof :  Since  ti  .  =HlnH , 

1  i 

i p  (n .  ,)  =  tp  (hVih1  ,n...nH1nH,  h1  ,hh) 

£  i.J  J-l7  c'  2  2-1  j  J-l 

=  IP  ffH.QH.  ffi  •  •  •  fflffjVlfl,  tf1  .n/zz. 

Cl  1  2  2-1  y  J-l  J 

=  y»  ((h.<bh.  ®  ...  ®//  J-Vifletf1,  ff1  n hqh1] 

C  2  2-1  J-l  J 

=  TPc{'{'Hi®Hi_i®  ...  ©ay1, 

«  •••  fflff  .  fl  0 

«% 

The  result  stated  in  the  next  lemma  is  due  to  Lorch[Ll] , 
but  has  been  rediscovered  many  times. 


Lemma  A2 :  Let  H ^  and  «2  be  closed  subspaces  of  a 

Hilbert  space  V.  Then 

wv  >  ° 

if  and  only  if  H^H  is  closed. 


Now  let  H  and  H  ( 1=1 ,2 , . . .  ,k)  be  closed  subspaces  of  a 


Hilbert  space  V  such  that 

*  -  WWV 

where  this  decomposition  is  not  necessarily  a  direct  sum  decomposi¬ 
tion.  Let  H,  =  H  n-'-nfl nff,,  and  let  the  orthogonal  projection 
operators  onto  H,  H.  and  ^  be  P,  P.  and  PjL.1>  respect¬ 
ively.  In  the  lemmas  below, let 

{  ’ 1 2‘ - 1o^  =  ^  ’2 . *}' 

The  following  result  is  due  to  Halperin  [H2] . 


Lemma  A3:  1  im  fP  •••P.  P.  1  =  P. 

Wtuirrt  s*  n-*00l  1  l  2  .  k :  1 

m  2  1 


The  next  result  was  proved  by  AfriatfAl]  for  the  case  of 
two  subspaces. 

* 

Lemma  A4:  XU  -  P  •  • -P^.  p  1  *  Hk  i'  w*lere  J  denotes 
*•  lm  l2  ll> 

the  null  space  of  the  indicated  operator. 


Proof:  It  is  easy  to  verify  that 


Now  let  *ex  j./ 
which  implies 


U  - 


H.  c  x\l  -  P.  •  •  -P,  P .  ]  . 
k :  1  1  2  2,1 

m  2  li 

>.  • • -p.  P  1 . 
lm  l2  1 1> 


P  •••P,  P  |.  Then  we  have  x  =  P  •••P  P  x, 

lm  l2  1 


X  =  (P  •••P.  P.  fx, 
l  2  „  2  . 
m  2  1 
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for  all  n .  Taking  the  limit  as  /?-*<»  and  using  lemma  A3,  we  see 


v! 

V, 

V, 


•:»l 


that  x=P,  x .  This  shows  that  x&H ,  , ,  and  thus 
k:  1  k : 1 

x\l  -  P .  •  •  -P  P .  1  c  H. 

L  a  2  lJ 

Now  the  result  follows.  □ 


Now  recall  that  M  .=  H  .nH ,  and  n .  is  the  orthogonal 
projection  operator  onto  M  . 


Lemma  A5:  The  operator  (I  -  n.  •••/?.  n.  )  is  invertible. 


Proof:  From  lemma  A4  we  have 


Since 


we  have 


x\i  -  a.  ■■•n.  n  I  *  n, 

I  1  l  _  l  ,  I  k :  1 

K  m  2  ii 


n.  ,=  • -n«tn«tnH 

k:l  k  2  1 

=  ffVltf 


■ 


This  proves  the  lemma,  n 


v?  v v;Vvv 
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